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[57] ABSTRACT 

Automobile navigation system utilizes a wide angle CCD 
camera that is coupled to the vehicle to receive video images 
of signs being approached by the vehicle. The user (e.g., the 
driver) of the system supplies via an input keyboard the 
desired destination of the vehicle and by using, e.g., a digital 
compass, the current direction of travel of the vehicle is 
ascertained. Then, by utilizing a computer system having 
therein a road database and optical character recognition 
software, the system converts the video images to road data 
that identifies the current location of the vehicle, and deter- 
mines from the current location of the vehicle and the 
desired destination a desired route of travel. Specific audio 
directions then are supplied to the driver depending on the 
vehicle's current location and desired route of travel. 

26 Claims, 1 Drawing Sheet 
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AUTOMOBILE NAVIGATION SYSTEM is supplied to the driver either every time the speed limit is 

posted or, alternatively, only when the posted speed limit 

BACKGROUND OF THE INVENTION changes. 

The present invention relates to an automobile navigation « ^ mother aspect of the present invention speed data 

system and, more particularly, to a navigation system 5 ^presenting the current travelling spwd of the vehicle is 

designed to provide useful information, including directions rece ! ved , <?*• from , lhe speedometer of the vehicle), a 

and safety instructions to drivers of automobiles and other recei ^ d vldeo J sl 8" al representing a road sign posting a 

motor vehicles speed limit is identified, and an audio warning (e.g., slow 

, i ' , , • . , . down") is given when the current travelling speed of the 

As is known, the use of an automobile requires both the 30 vehicle ^ ter {han the ted d limit b a deter . 

knowledge of one s destination and the ability to arrive at mifled amQum ( 1Q fa) 

that destination safely. - , ' , 

_ As yet a further aspect ot the present invention, video 

Throughout the years, there have been a number of safety si b represenling p redesignale d road signs (e.g., stop 

features that have been added to automobiles in order to si idd si m boom sJ } afe idenIifled> and audio 

reduce the risk of injury to dnvers and passengers of motor is warnin of the a p proachln ent of the predetermined road 

vehic es as well as to pedestrians With respect to the si b afe d , jed Qf> dtenuUwely „ t supplied 

knowledge of which streets and highways to take to arrive wheQ ^ curtem ^ of lfae vehide ^ f 

at one s desired destination, maps are available m assisting , hao a predetermined speed (e.g., 30 mph ). 

one's trip. However, there have been recent developments in . , ,. . , . 

automobile navigation systems which are known as global 20 • ^ a feature of ancillary information (e.g the 

positioning systems (GPS). Unfortunately, such systems are amount of mone y ne «! ed to ™ an »P«™ing toll) regarding 

expensive since they require global positioning system a roa S1 8 na 15 SU PP ie ■ 

hardware, graphical map display hardware, digital com- As vet another aspect of the present invention, fuel data 

passes and on-board computers. representing the amount of fuel remaining in the vehicle is 

Another problem with such devices is that they force 25 received, a received video signal representing 

drivers of automobiles to stop looking at the road so that location is identified, and an audio warning of the approach- 

they may view a graphical display for directions. These m ^ nt ° u f the fuel ^J™* locatlon » supplied to the dnver 

so-called distractions result in increased probability for an whei \ the amoimt of foel remau ™g 1Q the vehicle * below 

accident to occur. a Predetermined amount. 

30 



OBJECTS OF THE INVENTION 



BRIEF DESCRIPTION OF THE DRAWINGS 



, . - , . . The following detailed description, given by way of 

rherefore, it is an object of the present invention to e k and nQt (0 ^ ^ n , m ^ oa 

provide an automobile navigation system which overcomes ^ ^ ^ ^ a iated m with 

the shortcomings of existing devices. 35 ^ accompanying where in like references numer- 

Another object of the present invention is to provide an a is denote like elements and parts, in which: 
automobile navigation system which assists drivers in the pjo. 1 is a block diagram of the automobile navigation 
navigation of automobiles in a totally safe manner. sys(em of ^ invention; ^ 

A further object of the present invention is to provide an plGS 2A _ 2Q m schematic Orations of exemplary 

automobile navigation system which operates to increase the 40 ^ ^ which ^ ^ (o ^ ^ ^ ^ 
safety of driving automobdes while providing navigation aulomobile navigalion system of the present invention, 
instructions to the dnvers thereof. 

Various other objects, advantages and features of the DETAILED DESCRIPTION OF CERTAIN 

present invention will become readily apparent to those of PREFERRED EMBODIMENTS 

ordinary skill in the art, and the novel features will be 45 ^ . . . . c t , 

«. , , • t , t • , u i j i ■ The automobile navigation system of the present lnven- 

particularly pointed out in the appended claims. , . . . , t? 1 . / c A . , 

1 J r tion determines the global position of automobiles, provides 

SUMMARY OF THE INVENTION audible directions to drivers of the automobiles, and further 

provides audible safety instructions in certain circum- 

In accordance with one embodiment of the present 50 stances. For purposes of the description herein, the term 
invention, automobile navigation system and corresponding "automobile" is understood to represent any motorized 
method are provided for receiving (e.g., via a keyboard) a vehicles, including, but not limited to, automobiles, trucks, 
desired destination of the vehicle (e.g., automobile, truck, sport utility vehicles, recreational vehicles, motorcycles, etc. 
etc.), receiving from a CCD camera (coupled to the vehicle) Referring now to FIG. 1 of the drawings, a block diagram 

video signals that represent road signs being approached by 55 0 f the automobile navigation system of the present invention 
the vehicle, determining a current direction of travel of the is shown. The automobile navigation system includes a 
vehicle (e.g., by the use of a compass), converting the computer system 10, which generally includes therein a 
received video signals to road data that indicate the current central processing unit, permanent memory (ROM), tempo- 
location of the vehicle, determining from the current loca- rary memory (RAM) and input/output (I/O) capability. The 

tion of the vehicle and the desired destination a desired route 60 automobile navigation system further includes a user text 
of travel of the vehicle, and outputting to a driver of the display 12, a user input device 14, an audio output device 
vehicle audio directions based on the current location of the ( e> g tj a speaker) 16, a digital compass 18, and a wide angle 
vehicle, the current direction of travel of the vehicle and the CCD camera 20. In addition, the automobile navigation 
determined desired route of travel. system receives from the speedometer of the automobile a 

As one aspect of the present invention, a received video 65 speed signal identifying the current speed of the automobile, 
signal that represents a road sign posting a speed limit is Alternatively, the automobile navigalion system may 
identified, and an audio indication of the posted speed limit include its own dedicated speedometer which identifies the 
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current speed of the automobile in which the automobile supplied thereto (as previously discussed), and accesses its 

navigation system is installed. road map data base to determine whether or not the driver 

Computer system 10 has stored therein known optical must take some action, other than to remain on the same road 

character recognition software and road map data base files. in the same direction, to stay "on route" to the desired 

The optical character recognition software converts bit map 5 destination. Thus, the automobile navigation system ascer- 

image data supplied from camera 20 (to be discussed) into tains all turns and highway exits (and other necessary 

recognizable patterns, for example, street signs identifying actions) to take prior to (or, alternatively, during) the trip and 

the streets on which the automobile currently is located. as tn e automobile approaches a turn or highway exit (or 

In accordance with the present invention, wide angle omer action) that should be taken, computer system 10 

CCD camera 20 is mounted on an appropriate location 1Q sxip p Ue s to audio output device 16 an appropriate audio 

(either interior or exterior) of an automobile and is capable instruction that informs the driver of the action to be taken, 

of imaging areas in front of and to the side of the automobile. Fof examp i e( ^ tne automobile approaches a highway exit 

CCD camera 20 supplies the imaged areas as a video signal ^ shou]d ^ taken [Q remain on rout6j lhe audible inslmc . 

(e.g., as bit map data) to computer system 10 which utilizes tion « take lhis exit » is supplied to the ^ ThuSf any and aI i 

the optical character recognition software algorithms therein J5 mstructions lhal ^ driver needs t0 arrive a t the desired 

to convert the supplied video signals into a recognized road desliDa tion by means of the desired route are supplied in the 

sign by utilizing various information within the supplied form of audio inslructions> 

video signal including the text sign data (i.e., the words . . . . . , . . u „ . , 

♦ j « . x • * i. a .u - M In addition to being able to recognize street signs, such 

printed on the sign), the sign image shape, and the sign , . * a ir ,if * u*i • .• 

• 1 u \ n ■ t .ufL .1™ as shown in FIGS. 2B and 2C, the automobile navigation 

image colon's). By using each of these three elements, road _ n . ' . . . & 

sign! are d^tingmshed from billboards, store front signs, 20 s y slem of the presen invention further is operable to rec- 

etc. Computer system 10 then accesses a road map data base ot * er sl S ns "chi&Pg. f fo ' exam P le ' a s P ccd hmit S1 8 n ' 

therein to determine the current location of the automobile. such 85 shown m 2A of the drawul 8 s * 

The road map data base may include data pertaining to road As an aspect of the present invention, computer system 10 

names and numbers, road vectors, highway exits, town/ supplies an appropriate audio warning to the driver such as, 

country/state names, as well as any other data that may be for example, "entering a twenty-five mile per hour area", 

useful in the navigation from one location to another. Using when the speed limit as posted on the imaged sign indicates 

the optical character recognition software, the recognized "25 mph". Alternatively, speed limit changes may be stored 

road sign may be a road number, a road name, a town name, ™ the road map data base, and when computer system 10 

a road direction (e.g., north, south, east or west), a mile determines that the automobile is in an area having a 

marker etc changed speed limit, an appropriate audio warning can be 

Computer system 10 receives from compass 18 a compass P ravided via the audio °*P ut or appropriate text can be 

heading direction signal identifying the current compass provided on user display 12. 

heading of the automobile, such signal being utilized to As a further aspect of the present invention, computer 

access the map data base. 35 system 10 can utilize the current speed of the automobile, as 

Prior to beginning a trip (or even possibly during the trip), provided for by the speed signal supplied from speedometer 

a user (e.g., the driver of the automobile) enters the desired 22, to instruct the driver to "slow down" when the posted 

destination via user input device 14, which may be in the speed limit (whether changed or not) is substantially less 

form of a keyboard. Alternatively, user input device 14 is a than (e.g., 10 mph less than) the current speed of the 

microphone or other audio receiver which receives audio 40 automobile. The user can also predefine the amount at which 

information (i.e., spoken information) from the user, such the audio warning should be given. For example, the user 

audio information being converted in computer system 10 to could instruct the automobile navigation system to warn the 

destination data indicating the desired destination of the driver when the speed limit is exceeded by at least ten miles 

automobile. The user may also supply the current location of per hour, and if the automobile exceeds the speed limit by at 

the automobile if such information is not readily available to 45 least this amount, the audible instruction "exceeding limit" 

the automobile navigation system, for example, as when the is provided. 

automobile is parked in a garage. As another feature of the present invention, the automo- 

From the current location of the automobile (either user bile navigation system can be programmed by the user to 

supplied or derived from the video images, as discussed warn the driver of particular signs including, for example, 

above) and the entered destination, computer system 10 50 st op signs, yield signs, school zone signs, etc. Appropriate 

accesses its road map data base to derive one (or more) audible instructions may be supplied each time selected 

routes to the destination. One route may represent the signs are approached, or, alternatively, appropriate audible 

quickest route to the destination, while another route may instructions are supplied only when selected signs are 

represent the "easiest" route, depending on the needs of the approached and the current speed, as indicated by the speed 

driver (e.g., prefers highways to streets, etc.). Computer 55 si g nal supplied from speedometer 22, exceeds predeter- 

system 10 then supplies to user display 12 (e.g., a text mined amounts thus indicating that the driver may not be 

display) particular information that is displayed thereon, aware of the approaching sign. For example, if the automo- 

including, for example, the desired destination, its location bile is approaching a stop sign (as imaged by CCD camera 

in terms of number of miles and direction, and the current 20 or as indicated in the road map data base) and the current 

speed limit (as shown). The display 12 may provide other 60 s Pe ed of lne automobile is, e.g., 40 mph, computer system 

information including, but not limited to, the particular route 10 would supply via audio output 16 the audio message 

selected. It is noted that while the preferred embodiment "stop sign ahead". Thus, automobile and pedestrian safety 

includes user display 12, such a display is not necessary to are greatly enhanced with such warnings being provided, 

carry out the functions of the automobile navigation system In accordance with another embodiment of the present 

of the present invention, as will be discussed. 65 invention, the automobile navigation system is operable to 

Upon beginning the trip, computer system 10 ascertains receive from the automobile's fuel gauge, a fuel gauge 

the automobile's present position using the video data signal indicating the amount of fuel in the gas tank. In such 
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case, audible warnings can be provided when it is deter- direction of travel of said vehicle and the determined desired 

mined that the fuel tank is low. Alternatively, audible warn- route of travel; and for controlling said audio output means 

ings (or instructions) that a recognized service area (as to output to said driver an audio instruction corresponding to 

imaged by CCD camera 20) is being approached can be the upcoming action to be taken. 

provided only when the fuel tank is low. Still further, the 5 3 - The automobile navigation system of claim 1, wherein 

presence of service areas can be included in the road map said means for receiving video signals is comprised of a 

data base, wherein appropriate audible instructions to "fuel CCD camera coupled to said vehicle for imaging signs being 

up the tank" can be provided when a subsequent service area approached by said vehicle and for converting said imaged 

(after the current one being approached) is relatively far sl ^J? ^ video signals. 

r t °, T * u-i m. »u 4. The automobile navigation system of claim 1, whe rem 

from the current position of the automobile. Tims, the 10 ^ * ^ video 

automobile navigation system can be utilized to ensure that esenti a road si ^ sti a ^ Iirmt and t0 OTn ^ ol 

the fuel tank of the automobile never becomes empty. said audio outpm means tQ output tQ said driver an audio 

The automobile navigation system of the present inven- indication of the posted speed limit, 

tion further is operable to recognize other types of signs in 5. The automobile navigation system of claim 1, wherein 

which appropriate driver action may be necessary. For is sa j d control means is operable to identify a video signal 

example, the recognition of toll booth signs may be audibly representing a road sign posting a speed limit and to control 

supplied to the driver, as well as the amount of money that said audio output means to output to said driver an audio 

is required for the toll. As another example, the recognition speed limit change warning when the posted speed limit 

of road construction signs can result in audible instructions changes. 

to "slow down". Of course, other useful information can be 20 6. The automobile navigation system of claim 1, further 

audibly supplied to the user, including the amount of esti- comprising means for receiving speed data representing a 

mated travel time and the approximate mileage remaining to current travelling speed of said vehicle; and wherein said 

reach the desired destination. control means is operable to identify a video signal repre- 

From the foregoing discussion, it is seen that the auto- a road si S D P ostin & a ^ limit ' and t0 contro1 »«* 

mobile navigation system of the present invention operates 25 audl ° 0Ut P ut meaas t0 0Ut P ut to 531(1 dnver an audl ° warning 

to ascertain a desired route to a selected destination, to when the current travelling speed of said vehicle is greater 

provide audible destination instructions to the driver so that tnan the P osted s P eed hmit bv a predetermined amount, 

the automobile may reach the desired destination without the 7 * ™« automobile navigation system of claim 6, wherein 

use of, for example, a map, to provide cautionary instruc- said °° n ^ means is further operable to control said audio 

tions to maximize driver, passenger and pedestrian safety, 30 out P ut means t0 0Ut P ut t0 said driver said audio warnin S 

and to provide other types of information that are designed when the current travelling speed of said vehicle is greater 

to make the trip more enjoyable, safer and problem free (or, b y a predetermined amount than a last posted speed limit 

at least, minimizes possible problems) to the user. represented by a previously received video signal. 

While the present invention has been particularly shown 8 * ™f. automobile navigation system of claim 6, wherein 

and described in conjunction with preferred embodiments 35 said ™ dl ° waram S 15 anaudl ° ^truction to slow down, 

thereof, it will be readily appreciated by those of ordinary ?; ™ e ^mobile navigation system of claim 1, wherein 

skill in the art that various changes may be made without said contro1 means 15 to identify video signals 

departing from the spirit and scope of the invention. representing predetermined road signs, and to control said 

r • • • j j • *. j j 1 * , audio output means to output to said dnver audio warnings 

Therefore, it is intended that the appended claims be,,-,, r , « c -j j. • j ^ • 

. . . , ... rr , ... . 40 of the approachment of said predetermined road signs, 

interpreted as including the embodiments described herein, tn ^ t 5 t * 1 • n u • 

4 , y . f, , , ... . / 10. The automobile navigation system of claim 9, whe rem 

hereto D ^ equivalents ^ ^ ^ ^ Qpe / Me tQ ^ ^ 

e . re 7l °' . . . , . output means to output to said driver ancillary information 

What is claimed is: r ,. , 4 , r c , t . \ , . 

- A t ... . t . . regardmg selected ones of said predetermined road signs 

1. Automobile navigation system, co mpnsmg: ^ ^ n a roached 

means for receiving video signals representing standard C £ g a |he° a C utomobile navigation system of claim 10, 

road signs being approached by a vehicle; wherein sakJ contfol means coatrols ^ audio QUtput meaQS 

means for determining a current direction of travel of said t0 output audio m f ormat ion indicating an amount of money 

vehicle; needed for an approaching toll. 

means for receiving a desired destination of said vehicle; 50 12. The automobile navigation system of claim 1, further 

audio output means for outputting audio messages to a comprising means for receiving speed data representing a 

driver of said vehicle; and current travelling speed of said vehicle; and wherein said 

control means for converting predetermines ones of said control means is operable to identify video signals repre- 

video signals to road data indicating a current location senting predetermined selected road signs, and to control 

of said vehicle based on information including at least 55 said audio output means to output to said driver audio 

one of road sign text, color or shape; for determining warnings of the approachment of said predetermined road 

from said current location of said vehicle and said signals when the current travelling speed of said vehicle is 

desired destination a desired route of travel of said greater than a predetermined speed, 

vehicle; and for controlling said audio output means to 13. The automobile navigation system of claim 1, further 

output to said driver audio directions based on the 60 comprising means for receiving fuel data representing an 

current location of said vehicle, the current direction of amount of fuel remaining in said vehicle; and wherein said 

travel of said vehicle and the determined desired route control means is operable to identify a video signal repre- 

of travel. senting a fuel service location, and to control said audio 

2. The automobile navigation system of claim 1, wherein output means to output to said driver an audio warning of the 
said control means includes means for determining if an 65 approachment of said fuel service location when the amount 
upcoming action is to be taken by said driver of said vehicle of fuel remaining in said vehicle is below a predetermined 
based on the current location of said vehicle, the current amount. 
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14. Method of navigating a vehicle, comprising the steps 

of: 

receiving a desired destination of a vehicle; 

receiving video signals representing standard road signs 

being approached by said vehicle; 
determining a current direction of travel of said vehicle; 
converting predetermines ones of the received video 

signals to road data indicating a current location of said 

vehicle based on information including at least one of 

road sign text, color or shape; 
determining from said current location of said vehicle and 

said desired destination a desired route of travel of said 

vehicle; and 

outputting to a driver of said vehicle audio directions 
based on the current location of said vehicle, the current 
direction of travel of said vehicle and the determined 
desired route of travel. 

15. The method of claim 14, wherein said step of output- 
ting is carried out by determining an upcoming action to be 
taken by a driver of said vehicle based on the current 
location of said vehicle, the current direction of travel of said 
vehicle and the determined desired route of travel, and by 
outputting to said driver an audio instruction corresponding 
to the upcoming action to be taken. 

16. The method of claim 14, wherein said step of receiv- 
ing video signals includes the steps of imaging signs being 
approached by said vehicle by a CCD camera coupled to 
said vehicle and converting said imaged signs to said video 
signals. 

17. The method of claim 14, further comprising the steps 
of identifying a received video signal representing a road 
sign posting a speed limit; and outputting to said driver an 
audio indication of the posted speed limit. 

18. The method of claim 14, further comprising the steps 
of identifying a received video signal representing a road 
sign posting a speed limit; and outputting to said driver an 
audio speed limit change warning when the posted speed 
limit changes. 

19. The method of claim 14, further comprising the steps 
of receiving speed data representing a current travelling 
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speed of said vehicle; identifying a received video signal 
representing a road sign posting a speed limit; and output- 
ting to said driver an audio warning when the current 
travelling speed of said vehicle is greater than the posted 
5 speed limit by a predetermined amount. 

20. The method of claim 19, wherein said step of output- 
ting to said driver an audio warning is carried out also when 
the current travelling speed of said vehicle is greater by a 

10 predetermined amount than a last posted speed limit repre- 
sented by a previously received video signal. 

21. The method of claim 19, wherein said audio warning 
is an audio instruction to slow down. 

22. The method of claim 14, further comprising the steps 
is of identifying received video signals representing predeter- 
mined road signs; and outputting to said driver audio warn- 
ings of the approachment of said predetermined road signs. 

23. The method of claim 22, further comprising the step 
of outputting to said driver ancillary information regarding 

20 selected ones of said predetermined road signs being 
approached. 

24. The method of claim 23, wherein said step of output- 
ting ancillary information is carried out by indicating an 
amount of money needed for an approaching toll. 

25 25. The method of claim 14, further comprising the steps 
of receiving speed data representing a current travelling 
speed of said vehicle; identifying received video signals 
representing predetermined selected road signs; and output- 

30 ting to said driver audio warnings of the approachment of 
said predetermined road signals when the current travelling 
speed of said vehicle is greater than a predetermined speed. 

26. The method of claim 14, further comprising the steps 
of receiving fuel data representing an amount of fuel remain- 

35 ing in said vehicle; identifying a received video signal 
representing a fuel service location; and outputting to said 
driver an audio warning of the approachment of said fuel 
service location when the amount of fuel remaining in said 
vehicle is below a predetermined amount. 

40 

***** 



08/04/2004, EAST version: 1.4.1 



